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1. Introduction 



1.1 Purpose of the ADSS Cost Study 

Understanding the cost of resources used in substance abuse treatment is of critical 
concern to policymakers, payers, and providers of care. Federal and State policymakers are 
interested in cost-effective allocation of limited funds and in developing efficient financing 
structures to deliver substance abuse treatment services. State agencies, Medicaid, and managed 
behavioral health organizations allocate resources among types of care. Substance abuse 
treatment organizations are oriented toward producing services efficiently, setting appropriate 
charge rates, and negotiating contracts with managed care organizations. Each of these decision 
makers can use improved information about the costs of substance abuse treatment to better 
serve patients receiving treatment. 

The Alcohol and Drug Services Study (ADSS) was performed from 1996 to 1999. ADSS 
is a national study conducted in three phases to collect representative data on the characteristics 
of substance abuse treatment facilities, clients in treatment, post-treatment client status, and 
financing of care in the specialty substance abuse treatment sector. This sector includes 
freestanding substance abuse treatment centers, methadone maintenance clinics, and other 
facilities that primarily serve persons with substance abuse problems. 1 Phase I of ADSS 
surveyed a nationally representative set of 2,395 treatment facilities by telephone. Phase II 
conducted in-person interviews with administrators regarding revenues, costs, and staffing, and 
it analyzed a client record abstraction at a subset of 280 facilities. Phase III conducted follow-up 
interviews with a sample of clients for whom records were abstracted. ADSS data are an 
important aid in understanding the organization of treatment, cost and availability of treatment 
services, characteristics of the client population, and managed care contract arrangements. 2 

The purpose of the ADSS cost study was to provide a detailed data file and national 
estimates for cost, revenue, counseling activities, and staffing collected from a nationally 
representative sample of substance abuse treatment facilities. A new, more accurate cost 
collection strategy was developed for this study and is described in the following steps. 

First, cost, revenue, personnel, client volume, and counseling activity data were collected 
from a sample of facilities as part of Phases I (2,395 facilities) and II (280 facilities) of ADSS. 
Although hospital inpatient facilities were sampled and included in the larger ADSS Phase I 
facility telephone survey, they were excluded from the Phase II site visit data collection in order 
to sample more facilities that better represented the predominant types of care. 3 After data 
collection was completed, an intensive facility callback process was undertaken to review cost, 



1 The types of facilities that define the sector coincide with the sampling strata used in the study: hospital 
inpatient, non-hospital residential, outpatient-predominantly methadone, outpatient-nonmethadone, and combined 
types of care. For the outpatient, non-methadone type of care, the sample was further stratified to reflect whether or 
not facility clients were almost exclusively alcohol abusers. A seventh stratum was included for facilities whose type 
of care could not be determined based on existing information at the time of sampling. Types of facilities excluded 
from the ADSS sampling frame were halfway houses without paid counselors, solo practitioners, correctional 
facilities, Department of Defense and Indian Health Service facilities, and facilities that were prevention or intake 
and referral only. 

2 The documentation and data files for ADSS can be found at the following website: 
http://www.icpsr.umich.edu:8080/ ABSTRACTS/03088. xml?format=SAMHDA-DISPLAY. Two documents are of 
particular interest: Codebook, Part 2: Phase II, Administrator Interview (filename: cb3088p2.pdf.gz) and Phase II, 
Administrator Interview Questionnaire (Part 2) (filename: qu3088p2.pdf.gz). 

3 However, 13 of the 280 facilities in Phase II had a hospital inpatient unit in combination with an eligible 
residential or outpatient unit. The cost data were collected for these 13 hospital units, but they were not 
representative of all hospital facilities nationwide. As a result, they were excluded from the cost analysis. 
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personnel, services, and client data submitted by these facilities. 4 This callback process began in 
May 1998 and was completed in September 1999. Staff used an innovative spreadsheet data 
audit instrument developed by Capital Consulting Corporation (CCC) to simultaneously analyze 
and update the data file on each facility during the callback process. The instrument incorporates 
a series of reliability checks to aid in obtaining the most accurate data possible (Zarkin et al., 
1995). 

1.2 Outline of the ADSS Cost Report 

This report provides a detailed description of the methods used in the ADSS cost study, 
along with findings regarding key cost variables important to understanding the use of resources 
in substance abuse treatment. This report contains the first findings from the rich ADSS cost data 
base; much more analysis remains to be done. The first section of the report provides an 
overview of methods used in prior studies to estimate substance abuse treatment costs and 
describes the need for a more accurate and efficient way to collect treatment cost data in large 
national studies. 

The second section describes the methods used in the ADSS cost study to verify data 
collected in the ADSS. These methods involve the application of a computerized data audit 
instrument, a spreadsheet workbook used to enter and review selected questionnaire data from 
Phases I and II of the ADSS. 

The third section discusses data quality control analyses. Analyses of the distribution of 
data sources for key questionnaire variables collected in ADSS are discussed. These analyses 
indicate that a standard questionnaire administration is insufficient for collecting accurate 
substance abuse treatment cost and revenue data. 

The fourth section discusses the ADSS cost study findings. Three types of cost measures 
are examined: unit cost estimates, personnel costs, and national estimates. Mean unit cost 
measures such as "cost per admission," "cost per enrolled client day," "cost per visit," and "cost 
per counseling hour" are presented for three types of care: nonhospital residential, outpatient 
methadone, and outpatient nonmethadone treatment. Personnel cost analyses include cost per 
counseling hour, mean fringe benefit rates, mean hourly personnel rates, the proportion of 
personnel costs to total facility costs, and the proportion of personnel category costs to total 
personnel costs and are presented for all three types of care. National cost-adjusted estimates for 
the three types of care are developed by considering the estimated point prevalence client count 
for each type of care and the estimated cost per enrolled client day. 

Section 5 discusses results and the implications for estimating substance abuse treatment 

costs. 



4 The Phase II questionnaire can be found at the following website: 
http://www.icpsr.umich.edu:8080/ABSTRACTS/03088.xml?forinat=SAMHDA-DISPLAY: Phase II, Administrator 
Interview Questionnaire (Part 2) (filename: qu3088p2.pdf.gz). 
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1.3 Previous Methods 



The task of collecting and analyzing cost data in substance abuse treatment is 
complicated by a lack of standard methods of indirect cost allocation 5 and poor record keeping 
or management information systems. As a result, cost data vary in quality and reliability. To 
better understand the economics and financing of substance abuse treatment services, several 
cost analysis methods have been developed over the past decade to capture improved data on 
direct and indirect substance abuse treatment costs and revenues. These include the Drug Abuse 
Treatment Cost Analysis Program (DATCAP) (French, Dunlap, Zarkin, McGeary, & McLellan, 
1997) and CCC's Cost Allocation Methodology (CCC, 1993). 

DATCAP is a comprehensive 34-page cost analysis survey instrument that can be applied 
to all types of substance abuse treatment providers. This extensive survey can be customized for 
individual treatment settings and is structured to capture improved data on a facility s total 
resource use. The survey requires an extensive inventory of information on revenue data, client 
volume, personnel counts and rates, supply and material costs, contracted services, building and 
facility costs, and detailed information regarding equipment use and costs. The model attempts 
to estimate both accounting and economic costs and to generate average cost estimates. 1 his 
survey allows for a detailed audit at the treatment site level and is feasible for large samples ot 
substance abuse treatment providers. DATCAP is an economic approach to measuring costs. 

CCC's Cost Allocation Methodology, in contrast to DATCAP, is an accounting-based 
model Financial data are collected, analyzed, and presented in accordance with generally 
accepted accounting principles (GAAP). Data are collected and analyzed on-site at facilities by 
professional accountants. CCC has developed tools for collecting and calculating actual engt s 
of stay, admissions, discharges, and treatment staff services and hours. Furthermore, the firm has 
developed data validation procedures to test the accuracy of provider-supplied statistics. CCC s 
model produces for each facility average cost estimates including cost per client, cost per 
admission " and "cost per day." The CCC model is highly detailed and requires approximately 
12 hours of on-site data collection and validation, 24 hours of analysis time, and 4 hours ot 
quality assurance review, totaling 40 hours of work per site. This highly intensive method is not 
feasible to apply to large-scale nationally representative data collection. 

CCC's experience with the Cost Allocation Methodology served as the basis in 
developing the analysis/telephone callback techniques and data audit instrument implemented in 
the ADSS cost study. From their experience in examining cost data in substance abuse treatment 
facilities, CCC was able to indicate which benchmark variables would be most important to 
include in the ADSS data audit instrument. These variables include the unit cost variables 
indicated above plus information pertaining to personnel, counseling, and total facility costs. 
CCC also provided consultation and training for staff involved in the ADSS cost study to 
communicate clearly and effectively with substance abuse treatment facilities about the variables 

of interest. 

1.4 Need for an Efficient Strategy to Capture Cost Data 

To capture substance abuse treatment cost data from a nationally representative sample, 
the ADSS cost study used the Cost Allocation Methodology to obtain accurate data. The 
methodology depends upon a computerized data audit instrument. This instrument was used in 



5 Indirect cost allocation is the process of assigning costs of support services and personnel to client care. 
The task of collecting and analyzing cost data in substance abuse treatment is complicated by the lack ot a 
standardized reimbursement system for substance abuse treatment services. These services are generally publicly 
funded and thus a substance abuse treatment organization has no need to develop the cost of services beyond the 
program level. Substance abuse treatment organizations often maintain and report expenditures at an aggregate level 
of care such as residential or outpatient services. 
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^Inco 011 with an > ntensive facility callback process based on data collected in Phases I and II 
of ADSS from a sample large enough to be stable and representative. The next section addresses 
in detail the methods of the ADSS cost study. 
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2. Data Verification Methods of the ADSS Cost Study 



2.1 Study Design 

The ADSS cost study methods involved a multistage data collection and verification 
process. Initial data were collected through the ADSS Phase I and Phase II surveys from 1996 to 
1999. Phase I was a telephone interview with the facility directors of a national stratified 

probability sample of approximately 2,395 substance abuse treatment facilities. The 

questionnaire was mailed to the facility 2 weeks prior to the interview to allow the facility time 
to collect the information. Follow-up telephone calls were done as needed. This phase of the 
study was conducted between December 1996 and June 1997. Phase II included site visits to a 
subsample of 280 of the Phase I facilities for a personal interview with the facility director and 
client record abstraction for a sample of over 6,000 clients from these facilities. This phase of the 
study was conducted between August 1997 and April 1999. For each facility, information was 
obtained on program treatment type (hospital inpatient, nonhospital residential, outpatient 
nonmethadone, and outpatient methadone), costs, clients served, and services provided. More 
detailed information on the facility selection and data collection procedures is presented in the 
citations in the second footnote. Facilities offering only hospital inpatient treatment, although 
included in the ADSS Phase I survey, were excluded from Phase II and the cost study analysis 
for the reason cited in the third footnote (see also footnote 1 in Table 2.2). 

The 280 substance abuse treatment facilities included in Phase II offered one or more 
types of care (i.e., were single or multiple modalities). Table 2.1 provides a distribution of types 
of facilities in the ADSS cost study, and Table 2.2 provides the distribution of types of 
modalities. 



Table 2.1 Distribution of Sample Facilities Responding to ADSS Phase II Cost Study 



Type of Facility 


Sample Size 


Single Modality 


^38 | 


Multiple Modality 


42 


Total 


280 



Table 2.2 Distribution of Modalities in the 280 Sample Facilities 



Type of Care (Modality) 


Sample Size 


Hospital Inpatient 


13 


Nonhospital Residential 


48 


Outpatient Nonmethadone 


222 


Outpatient Methadone 


44 


Total Modalities 


327 


Eligible Modalities' 


314 



1 The number of eligible modalities is equal to 327-13 (Inpatient units) = 314. Facilities with hospital inpatient 
care only and hospital inpatient units in multiple modality facilities were excluded from the cost study. 



To obtain more meaningful results, most analyses for the ADSS cost study were 
conducted at the modality or type of care level. The ADSS cost study was governed by the 
sampling universe from which facilities were selected. A sampled "facility" could be one of 
several levels in the treatment system, including a type of care. The ADSS cost study measured 
the costs of the sampled facility and, if it covered several types of care or modalities, then the 
cost study callback procedure broke the costs and activities down by type of care. Moreover, 
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facilities vary in their reporting of financial data. Facilities are generally able to distinguish costs 
between residential and outpatient services. If the questionnaires had attempted to obtain more 
detailed financial data, many facilities would have been unable to furnish accurate data. 

Facilities can readily aggregate data, but disaggregation requires considerably more effort than 
many facilities were willing to do, thus potentially reducing participation rates in the study. Data 
items for the facility were entered into a spreadsheet data audit instrument for analyses at the 
modality level. For example, unit costs per admission were identified in each of three types of 
care: outpatient nonmethadone, outpatient methadone, and nonhospital residential treatment. 

Within the residential and outpatient nonmethadone samples, different subtypes of care 
were represented. For example, residential treatment units may include both detoxification and 
rehabilitation services. Moreover, outpatient nonmethadone treatment units may include a 
mixture of intensive and regular outpatient treatment. However, data were not analyzed for these 
more specific types of care. 

The cost analysis and data validation efforts began after the Phase II data collection. The 
data review worksheet or audit instrument was designed to compare Phase I versus II data for 
consistency, and validate both cost and statistical data. During an initial review of Phase I and 
Phase II data, the cost study analysts sought to identify missing data and inconsistent data. 
Subsequently, staff recontacted facility administrators through an intensive facility callback 
process to make an additional attempt to collect missing data and to verify specific data items 
that appeared inconsistent through the data audit analysis. The only callbacks involving Phase I 
data included facilities with Phase II cost data. The Phase I data were used to check consistency 
with Phase II data. Upon final review with facility officials, variables were recorded and 
described in the spreadsheet file as the most accurate data available. The source of updated 
information was noted. Upon complete review and updating of each facility record, data were 
transferred to the final ADSS cost study data file for research analyses. 

Time between the two phases of ADSS data collection was 6 to 12 months The cost 
study relied primarily on Phase II data. Except for a few items, the Phase I cost data were not 
validated nor extensively checked for internal consistency. 

The analysts found that 96.0 percent of the sample of facilities required a callback for at 
least one variable in question and, of this group, 99.7 percent of facilities assisted in further 
clarifying these data inconsistencies. 

2.2 Data Review Worksheet 

The data review worksheet is a spreadsheet workbook designed to analyze specific cost, 
revenue, staffing, client volume, and counseling data reported in Phases I and II of ADSS A 
copy of the data review worksheet is provided in Appendix A. The workbook includes five data 
entry pages, where data pertinent to the cost study from the original ADSS questionnaires were 
entered, and five analysis pages that include formulas linking to the data entry worksheets for 
further review. Each questionnaire variable included on the data review worksheet has an 
associated data source identifier that serves as an indicator of the final source of data entered into 
the cost study file (e.g., data originally supplied by facility director, data revised by facility 
director). This information helps identify which variables are reported most reliably by facility 
directors in the original questionnaire. The analysis pages also include a series of ratios that 
serve as key analysis variables in the study. These ratios enabled comparison of data from each 



1 A complete list of all specific questionnaire variables in the ADSS cost study is in Appendix B. 
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facility to expected industry norms identified through CCC's previous site visit research. ADSS 
cost analysts were trained by Robert Bennett of CCC to identify inconsistencies for discussion 
with facility officials. Inconsistencies could immediately be identified as deviations from 
expected ratios and reported to facility officials for further review. These procedures were 
designed to improve the internal consistency of data reported by sampled substance abuse 
treatment facilities. 

The specific data entry items, the primary key analysis ratios, and expected data ranges 
varied by data variable from 25 to 80 percent. The ranges developed were used as data screening 
tools and for the cross data variable validation process. Many of the initial questionnaires had 
missing data variables. These screening ratios were developed to inquire about submitted data 
that did not appear within normal limits. The study attempted to minimize the number of facility 
callbacks. The subsequent sections present more detailed information on the ranges. 

2.2.1 Questionnaire Variables 

Data items chosen for the ADSS cost study include client volume, total costs, total 
revenues, staffing, and information on individual and group counseling. These variables were 
necessary to derive estimates of the unit costs of substance abuse treatment, including cost per 
admission, cost per client day, cost per visit, and cost per counseling hour. Table 2.3 shows the 
questionnaire variables from Phases I and II of ADSS entered into the data audit spreadsheet 
workbook. Phase II involved a more detailed collection of client services and other data 
pertaining specifically to individual and group counseling sessions received by clients and 
personnel costs borne by the sampled substance abuse treatment facility. Three variables 
collected as part of Phase I were added to the cost study data audit spreadsheet midway through 
the cost study verification process and were therefore not verified with the facility: "Dollar 
Amount or Percentage of Costs Attributed to Employee Personnel," "Dollar Amount or ^ 

Percentage of Costs Attributed to Other Personnel (including consultants and other personnel), 
and "Dollar Amount or Percentage of Costs Attributed to Non-Personnel." There is less 
confidence in the reliability of these three measures because they were not subject to rigorous 
reliability checks. 

2.2.2 Source Identifiers 

Each questionnaire variable entered into the data audit instrument has an associated data 
source identifier. The source identifier indicates the final accepted source of data entered into the 
substance abuse treatment facility's cost study spreadsheet workbook. 

The following three source identifiers were used when dealing with data received directly 
from a facility during the study: 

• po - Provider Original (This includes data as reported in Phase I or II of ADSS 
with no change upon analysis or verification.) 

• pr - Provider Revised (This includes revised data via telephone callback 
with a facility official.) 

• PD - Provider Documentation (This includes data as submitted to cost 
study analysts from a facility official, e.g., financial statement, etc.) 



7 CCC has collected cost data on over 400 different programs. With few exceptions (fewer than a dozen), 
the majority are public-sector programs. The majority of these were selected by the Substance Abuse and Mental 
Health Services Administration (SAMHSA), were publicly funded, and offered services to those clients targeted by 
SAMHSA. If data values for a facility were not within the ranges for ratios developed for the data review worksheet, 
study staff reconfirmed selected data variables via a phone follow-up. 
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